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ABSTRACT 


Perceptual  activity  for  exploration,  probing  and  searching  is  very  important  in  computer 
vision.  For  the  purpose  of  intelligently  controlling  the  sensor’s  motion  and  parameters  for 
different  sensing  strategies  and  designated  tasks  in  perceptual  activity,  an  active  camera  sys- 
tem is  often  used.  An  active  camera  system  is  also  usually  used  for  vision-based  guidance. 
In  order  to  position  the  camera  system  accurately  and  to  obtain  the  relation  between  the 
camera  and  the  manipulator,  the  active  camera  system  must  be  calibrated. 

In  this  paper,  we  introduce  a modified  Denavit-Hartenburg  kinematic  model  and  de- 
velop a new  technique  to  calibrate  an  active  camera  system.  The  manipulator,  camera-to- 
manipulator,  camera,  and  base-to-world  calibrations  are  all  included.  The  method  employs 
four  ideas  : (1)  The  camera  poses,  joint  poses,  and  link  frames  calibrated  are  all  related  to 
the  world  frame,  therefore  the  camera-to-manipulator  and  base-to-world  calibration  is  very 
straightforward;  (2)  The  joint  poses  are  calibrated  separately;  (3)  The  manipulator  motion 
is  obtained  from  the  camera  poses;  (4)  Once  the  joint  poses  are  obtained,  the  link  frames  can 
be  defined  for  any  kinematic  model.  In  consequence,  the  whole  procedure  is  simple,  flexible, 
accurate,  and  efficient.  Two  experiments  are  performed  to  verify  the  accuracy  of  the  new 
technique. 
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1 INTRODUCTION 


1.1  Motivation 

Many  researchers  in  computer  vision  have  recognized  the  importance  of  perceptual  ac- 
tivity for  exploration,  probing,  and  searching  [5]  [2].  Passive  sensors  such  as  CCD  (Charge 
Coupled  Device)  cameras  mounted  on  an  active  camera  system  are  often  used  in  perceptual 
activity.  By  intelligently  controlling  the  sensor’s  motion  and  parameters  for  different  sensing 
strategies  and  designated  tasks,  perceptual  activity  can  be  accomplished.  Many  successful 
applications  of  passive  cameras  used  in  perceptual  activity  have  been  reported.  In  [3],  by 
intelligently  controlling  the  camera  motion,  solutions  to  the  shape  from  shading,  contour, 
and  texture  problems  become  well-conditioned  and  unique.  Reference  [4]  discusses  how  using 
a purposive  and  qualitative  approach  robustly  solves  many  navigational  problems  without 
reconstructing  the  scene.  Camera  fixation  (defined  as  actively  controlling  the  camera  mo- 
tion so  that  a fixed  point  in  space  is  always  imaged  to  the  same  position  in  the  image  plane) 
makes  image  interpretation  easier [17].  Using  two  types  of  constrained  camera  motion,  the 
depth  of  objects  in  bins  can  be  inferred[24].  Active  camera  systems  are  used  not  only  for 
perceptual  activity  in  computer  vision  but  also  in  robotics.  For  example,  an  active  camera 
system  is  often  used  for  vision-base  guidance[25]. 

In  this  paper,  we  consider  an  active  camera  system  which  has  one  or  more  cameras  rigidly 
mounted  on  a manipulator,  such  as  a robot  arm  or  a positioning  table.  The  manipulator  may 
be  modeled  as  a set  of  n moving  rigid  bodies  connected  in  a serial  chain  by  any  combination 
of  revolute  and/or  prismatic  joints.  These  moving  bodies  are  called  links.  Each  link  has  one 
degree  of  freedom  (DOF). 

A vital  issue  for  active  camera  systems  is  the  ability  to  accurately  know  the  state  of 
the  system  and  how  this  state  was  achieved.  Very  often,  the  positioning  inaccuracy  of  the 
manipulator  may  occur  due  to  manufacturing  tolerances  and  the  assembly  process.  For  ex- 
ample, in  our  vision  laboratory  a camera  is  mounted  on  a two  DOF  positioning  table,  with 
one  prismatic  joint  and  one  revolute  joint.  Ideally,  for  convenience  and  simple  computation, 
we  want  the  two  joint  axes  of  the  positioning  table  to  intersect  and  to  be  perpendicular  to 
each  other.  Also,  we  want  the  camera  center  to  be  located  at  the  center  of  the  rotation  axis 
and  the  initial  viewing  direction  of  the  camera  to  be  parallel  to  one  of  the  joint  axes.  In 
practice,  it  is  very  difficult  to  accurately  set  up  the  above  ideal  configuration.  The  cam- 
era pose  (position  and  orientation)  is  unknown.  Furthermore,  the  manipulator  motion  is 
typically  represented  in  terms  of  the  manipulator  base  frame,  while  the  visual  data  is  often 
expressed  with  respect  to  the  camera  frame.  To  relate  the  camera  and  the  manipulator, 
the  transformation  between  these  two  frames  must  be  determined.  Unfortunately,  it  is  very 
hard  to  directly  and  accurately  measure  the  transformation.  Therefore,  calibration  of  the 
active  camera  system  is  required  to  improve  the  positioning  accuracy  and  to  determine  the 
transformation  between  the  camera  and  the  manipulator. 

Due  to  the  importance  of  calibration,  the  goal  of  this  research  is  to  develop  an  accurate 
and  efficient  method  to  calibrate  the  active  camera  system.  A unified  calibration  of  an  active 
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camera  system  (see  figure  1)  includes  four  major  parts; 

(1)  The  manipulator  calibration  (i/®(V),  a 4x4  transformation  matrix  and  function  of  the 
commanded  joint  readings  V)  that  locates  the  end  frame  relative  to  the  base  frame. 

(2)  The  camera-to-manipulator  calibration  a 4x4  matrix)  that  finds  the  transformation 
between  the  camera  and  the  manipulator. 

(3)  The  camera  calibration  that  characterizes  the  inherent  properties  of  the  camera  and  op- 
tics and  determines  the  camera  pose  (i7jy(V),  a 4x4  matrix  and  function  of  the  commanded 
joint  readings  V)  between  the  world  frame  and  the  camera  frame. 

(4)  The  base-to- world  calibration  {H^ , a 4x4  matrix)  that  defines  the  transformation  be- 
tween the  base  frame  and  the  world  frame. 

In  figure  1,  Hf{V)  describes  the  transformation  between  the  camera  frame  and  the  base 
frame  and  is  a function  of  the  commanded  joint  readings  V.  All  the  above  transformations 
are  expressed  in  solid  lines  or  dash  lines  in  figure  1.  The  solid  lines  represent  the  fixed 
relation  between  two  frames,  while  the  dash  lines  means  that  the  relation  is  a function  of  V. 

1.2  Previous  Work 

In  previous  work  for  the  manipulator  calibration  {H^),  the  algorithms  differ  from  one 
another  in  three  ways;  the  kinematic  model  representation,  the  manipulator  parameter  iden- 
tification, and  the  measurement  devices  used.  A survey  may  be  found  in  [13].  The  selection 
of  the  kinematic  model  varies  in  different  approaches.  Based  on  the  definition  of  the  co- 
ordinate transformation,  four,  five,  six,  or  even  more  parameters  may  be  used.  Most  of 
the  methods  for  identifying  the  manipulator  parameters  fall  into  two  categories.  One  is  to 
formulate  the  problem  cis  a set  of  nonlinear  optimization  equations  and  solve  for  all  joints 
parameters  at  one  time  [16].  The  other  is  to  use  analytical  techniques  to  solve  the  parameters 
for  each  individual  link  [8]  [27]  [15].  As  to  the  choice  of  the  instrumentation  for  calibration, 
most  of  the  methods  require  expensive  devices  such  as  laser  scanning  systems,  laser  track- 
ing interferometer  systems,  selspots,  or  theodolites.  On  the  other  hand,  Tsai’s  method  [15] 
employs  a general  purpose,  off-the-shelf  common  CCD  camera  and  a calibration  target  block. 

One  method  of  achieving  a camera-to-manipulator  (sometimes  called  hand-eye,  head-eye, 
etc.)  calibration  (H^)  is  to  integrate  it  with  the  aforementioned  manipulator  calibration, 
then  formulate  a large  scale  nonlinear  optimization  problem  and  solve  the  parameters  for 
both  parts  simultaneously  [16]  [6].  This  approach  is  often  time-consuming,  and  it  needs  a 
good  initial  guess  for  convergence.  Another  approach  used  by  [18]  [10]  [23]  [9]  is  to  treat  the 
camera-to-manipulator  calibration  {H^)  alone,  and  solve  it  from  the  equation 

A B 

Here  A,  B,  and  are  all  4x4  matrices.  A is  the  change  in  the  manipulator  position  and 
B is  the  resulting  camera  displacement.  Note  that  in  order  to  apply  this  method  A and  B 
must  be  given  to  calculate  . This  solution  is  non-trivial. 

For  the  topic  of  camera  calibration,  a detailed  survey  may  be  found  in  [22].  A fast  and 
accurate  method  of  obtaining  the  intrinsic  and  extrinsic  parameters  which  relate  the  2D 
camera  image  and  the  3D  scene  is  described  in  [20].  The  implementation  of  Tsai’s  camera 


2 


calibration  algorithm  can  also  be  found  in  [19]. 

Calibration,  treated  as  a unified  problem,  has  been  discussed  in  several  papers.  Pusko- 
rius  [16]  integrated  manipulator  calibration  and  camera-to-manipulator  calibration  into  one 
large  scale  nonlinear  optimization  problem.  In  this  approach,  an  accurate  initial  guess  is 
often  required  and  a large  number  of  parameters  must  be  solved.  The  trio  method  devel- 
oped by  Tsai  and  Lenz,  which  includes  manipulator  calibration,  hand-eye  calibration,  and 
camera  calibration  has  been  a major  contribution  to  unified  calibration  [21].  This  approach 
is  generally  good,  but  there  are  limitations.  Instead  of  using  a general  kinematic  model  for 
the  manipulator,  this  method  focuses  only  on  Cartesian  robots.  In  order  to  calibrate  the 
rotation  axis,  some  linear  joints  may  also  be  exercised  to  keep  the  calibration  block  within 
the  field  of  view.  Although  there  are  two  elements  (the  orientation  and  the  position  of  the 
rotation  axis)  to  be  found,  only  the  orientation  can  be  calculated  by  this  method.  The  po- 
sition is  still  unknown.  The  hand-eye  calibration  is  currently  tedious,  but  there  is  room  for 
improvement.  The  work  by  Bennett  et  al  [6]  is  also  in  the  category  of  unified  calibration.  In 
this  approach,  no  external  measurement  device  is  needed.  However,  similar  to  Puskorius’es 
approach,  an  accurate  initial  guess  is  often  required  and  a large  number  of  parameters  must 
be  solved. 


1.3  Our  Approach 

Our  approach  has  the  following  features: 

(1)  It  is  a unified  calibration  method:  The  manipulator,  camera-to-manipulator,  cam- 
era, and  base-to-world  calibrations  are  all  included. 

(2)  The  camera  poses,  joint  poses,  and  link  frames  are  all  related  to  the  world  frame. 
Therefore  the  camera-to-manipulator  and  base-to-world  calibration  is  very  straightforward. 

(3)  Most  importantly,  the  camera-to-manipulator  calibration  as  well  as  the  base- 

to-world  calibration  are  the  by-products  of  the  manipulator  calibration.  The  procedure  of 
solving  A B is  no  longer  necessary. 

(4)  We  modify  the  Denavit-Hartenburg  kinematic  model  and  introduce  two  param- 
eters, scale  factor  and  zero-offset,  to  correct  the  joint  variable  values  used  from  the  joint 
encoder  readings. 

(5)  Since  the  method  calibrates  the  pose  relative  to  the  world  frame  for  each  indi- 
vidual joint,  only  the  form  of  one-equation-solving-one-parameter  is  used.  Therefore,  the 
computation  is  simple.  It  is  also  flexible  because  any  proper  starting  position  can  be  used 
for  each  joint  calibration,  and  the  sequence  in  which  joints  are  calibrated  does  not  matter. 

(6)  The  method  is  good  for  a manipulator  with  any  type  of  kinematic  model.  Since 
each  joint  axis  pose  solved  by  our  approach  is  expressed  in  reference  to  the  world  frame. 
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once  the  joint  pose  is  obtained,  the  individual  link  parameters  can  be  extracted  and  the  link 
frame  can  be  defined  for  any  kinematic  model. 

(7)  No  expensive  measurement  device  is  needed.  Only  a CCD  camera  and  a calibra- 
tion target  are  used. 

(8)  The  kinematic  camera  pose  can  be  written  as  a function  of  the  commanded  joint 
readings.  The  advantage  of  this  is  that  whenever  camera  motion  is  induced  by  the  manipu- 
lator, we  can  substitute  the  new  joint  readings  into  the  existing  camera  pose  function,  and 
the  new  camera  pose  can  be  obtained  right  away.  There  is  no  need  to  calibrate  the  camera 
pose  again. 


1.4  Outline  of  This  Paper 

In  the  following  sections,  some  backgound  for  our  derivations  is  first  introduced,  then 
the  procedures  and  equations  for  our  unified  calibration  method  are  elaborated.  Following 
that,  the  experiments  for  verifying  this  method  are  discussed  and  the  results  are  presented. 
Finally,  some  conclusions  are  drawn  for  our  method. 

2 THEORY 

2.1  Background 

The  background  below  is  useful  to  understand  our  mathematical  derivations. 

• Coordinate  frames 

All  coordinate  frames  defined  here  are  Cartesian  coordinate  frames,  as  follows: 

c:  The  camera  coordinate  frame  (figure  2)  is  attached  to  the  camera,  with  the  origin  at  the 
camera  center,  the  Z axis  coinciding  with  the  optical  axis,  and  the  X,  Y axes  parallel  to  the 
image  x and  y axes,  respectively.  Note  that  the  camera  frame  is  a moving  coordinate  frame, 
depending  on  where  the  camera  is. 

W:  The  world  coordinate  frame  (figure  3)  is  fixed  and  arbitrarily  selected.  The  coordinate 
of  each  target  point  on  the  calibration  plate  is  known  a priori  with  respect  to  this  frame. 

L:  The  link  coordinate  frame  i of  the  manipulator  is  attached  to  link  i ( figure  4).  Let  Zi 
and  Z,+i  lie  along  the  joint  axes  i and  i-fl  at  links  i and  i+l,  respectively.  AL  is  chosen 
as  the  unit  vector  perpendicular  to  both  Zi  and  .Zj+i,  and  Tj  is  found  by  taking  the  cross 
product  of  Zi  and  A,.  Note  that  the  link  frame  i is  a moving  coordinate  frame.  The  pose 
of  Xi  depends  on  the  commanded  joint  readings  at  joints  1 through  i while  the  pose  of  Z, 
depends  on  the  readings  at  joint  1 through  i-1. 
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B:  The  manipulator  base  coordinate  frame  is  regarded  as  the  reference  frame  of  the  manip- 
ulator fixed  in  space. 

• Transformations 


Let  us  introduce  three  interpretations  of  the  homogeneous  transform  H,  a 4x4  matrix 
containing  orientation  and  position  information [11]: 


H = 


■ R 
0 0 0 


T‘ 

1 


(1) 


where  R is  a 3x3  rotation  matrix,  and  T is  a 3x1  translation  vector 

(1)  Description  of  a frame 

Hq  describes  the  frame  B relative  to  the  frame  A. 


■ 1 

Oi] 

Rb 

Ti\ 

o 

o 

0 

1 

,000 

1 

(2) 


where  Xq^Y^,  and  are  3x1  unit  vectors  representing  the  coordinate  axes  X,Y,  and  Z of 
frame  B,  respectively,  and  Og  is  the  position  vector  of  the  origin  of  frame  B relative  to  frame 
A,  Rg  is  a 3x3  rotation  matrix  of  frame  B relative  to  A,  and  Tg  is  a 3x1  translation  vector 
of  frame  B relative  to  A. 


(2)  Transform  mapping:  changing  descriptions  from  frame  B to  frame  A 

In  figure  5,  we  have  a physical  point  P in  space.  and  P®  are  the  3x1  position  vectors  of 

point  P in  frames  A and  B,  respectively. 

We  can  calculate  P^  from 


(3) 


(3)  Transform  operator:  only  one  reference  frame  A involved 

The  operator  H^2  rotates  and  translates  a coordinate  frame  attached  to  a rigid  body 
into  a new  pose  (see  figure  6): 

= H*.,  * (4) 


The  following  are  some  basic  formulas  for  transformations: 
* Compound  transformations 


= (5) 


T’cl 

Ri*TS  + T§-\ 

.0  0 0 

1 

0 0 0 1 
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Note  that  Ri*R^  ^ Rc'^Rb 
* Inverting  a transform 


Ra 

rfl 

'{Ri)'  -{Riy*Tf 

,000 

1 

.0  0 0 1 

where  -1  and  t denote  inverse  and  transpose  of  a matrix,  respectively. 

2.2  Models 

Two  models  that  will  be  used  in  our  derivation  are  described  next: 


(7) 

(8) 


Manipulator  model 

Consider  a general  serial  link  manipulator  of  arbitrary  order  and  with  a combination  of 
revolute  and  prismatic  joints.  In  order  to  deal  with  the  complex  geometry  of  a manipulator, 
we  affix  a coordinate  frame  to  each  link  and  then  describe  the  relationship  between  these 
coordinate  frames.  A general  method  for  assigning  link  coordinate  frames  and  parameters 
to  a manipulator  was  developed  in  [12]  (see  figure  7).  The  location  and  orientation  of  the 
i-th  link  coordinate  frame  relative  to  the  i-1  th  link  coordinate  frame  can  be  represented  as 
a 4x4  homogeneous  transformation  matrix.  The  Denavit-Hartenburg  link  transformation  is 
obtained  from  [11] 


H] 


i-1 


c6i  —s6i 

s6icai-i  cOiCai-i 
s6isai-i  c9isai-i 
0 0 


0 ai_i 

CQ'j_i  cai-idi 

0 1 


(9) 


where  s and  c refer  to  the  sine  and  cosine  function,  a is  the  link  length,  a is  the  link  twist 
angle,  d is  the  link  offset,  and  0 is  the  joint  angle. 


In  order  to  correct  for  the  joint  variable  values  used  from  the  commanded  joint  read- 
ings, we  modify  the  D-H  model  and  introduce  two  parameters,  scale  factor  and  zero-offset, 
represented  as  follows: 


Oi  — 0*  + Si  • Vi  , 


di  = d*  for  a revolute  joint 


(10) 


and 


di  = d*  Si  • Vi  , Oi  = 0*  for  a prismatic  joint 


(11) 
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where  5,-  is  the  scale  factor,  Vi  is  the  commanded  joint  reading,  6*  is  the  zero-offset  of  the 
joint  angle,  and  d*  is  the  zero-offset  of  the  link.  The  scale  factor  s,  is  often  required  because 
the  commanded  joint  reading  Vi  must  be  converted  into  the  real  value  Oi  for  the  revolute  joint 
or  di  for  the  prismatic  joint.  On  the  other  hand,  the  use  of  a zero  offset  6*  or  d*  can  adjust 
6i  or  d,  to  correct  value.  Thus,  due  to  the  modification  of  equations  (10)  and  (11),  in 
equation  (9)  contains  the  constant  parameters  a,_i,  a,-!,  d* ^ 6* ^ si  and  one  variable  Vi. 

For  convenience,  we  choose  the  manipulator  base  frame  (called  B or  0)  to  coincide  with 
frame  1 when  the  commanded  joint  reading  V\  of  link  1 is  zero.  Thus,  we  will  always  have 

ao  = ao  = dl  = 61  = 0 (12) 

Similarily,  for  the  frame  of  the  last  link  m,  the  direction  of  Xm  is  chosen  to  be  aligned  with 
Xm-i  when  the  commanded  joint  reading  of  link  m is  zero.  Thus,  we  will  always  have 

d*m  = 0*m  = am  = O^m  = 0 (13) 

In  consequence,  the  location  of  the  last  link  m is  related  to  the  base  frame  B or  0 by  a 
sequence  of  D-H  transformations  as  follows: 

= (14) 


Camera  model 

A refined  camera  model  from  Tsai  [20]  is  described  in  figure  8 and  used  to  transform  the 
3-D  object  coordinates(A’iy , Yw,  Zw)  to  the  2-D  computer  image  coordinates  (a-/,  yj)  in 
pixels  using  the  following  steps. 

Step  1:  Transform  the  mapping  from  the  world  coordinates  {Xw-,  Yw,  Zw)  to  the  camera 
coordinates  (Xc,Yc,Zc) 


(Xc] 

Xw 

r -w 

Yc 

Zc 

II 

* 

Yw 

Zw 

^ = 

Rw 
.0  0 0 

Yw 

Zw 

1 J 

. 1 . 

. 1 . 

(15) 


where  R^y,  and  are  a 4x4  transform  matrix,  a 3x3  rotation  matrix,  and  a 3x1 
translation  vector,  respectively,  from  the  world  frame  W to  the  camera  frame  c and 


ri 

r2 

rs 

'T,' 

Ill 

r4 

rs 

re 

Ill 

Ty 

rg 

^9. 

[T.} 

(16) 


Step  2:  Perspective  projection  with  pin  hole  geometry 
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(17) 


- f 


(18) 


where  (rr^,  y^)  is  the  undistorted  2-D  image  coordinate  and  f is  the  effective  focal  length. 


Step  3:  Radial  lens  distortion 

Xd  = 2xulD, 

with 


Vd  = 2yulD 


^ = 1 + (i  -^hixl  + vDY^^ 

where  {xd,yd)  is  the  distorted  2-D  image  coordinate  and  ki  is  the  distortion  coefficient. 


(19) 

(20) 


Step  4:  Relationship  between  the  computer  image  coordinate  {xj,  yj)  and  the  distorted 
image  coordinate  {xd^yd) 

Xj  — Sx  ' Xd  ”1”  Cx 

yf~'^y‘yd'\~  Cy  (22) 

where  {Cx,  Cy)  is  the  computer  image  coordinate  for  the  origin  in  the  image  plane  and 
Sy  are  the  scale  factors  in  x and  y respectively. 

The  parameters  of  the  camera  model  may  be  decoupled  into  the  intrinsic  and  extrin- 
sic parameters.  The  intrinsic  parameters  characterize  the  inherent  properties  and  are  the 
effective  focal  length  / (lens  principal  distance),  lens  distortion  coefficient  image  scale 
factors  Sx  and  Sy  (relationship  of  the  computer  image  coordinates  in  pixels  to  the  true  image 
coordinates  ),  and  image  center  {Cx,Cy)  (the  point  where  the  optical  axis  intersects  with 
the  image  plane).  The  extrinsic  parameters  are  the  position  and  orientation  R\y  of  the 
world  reference  frame  relative  to  the  camera  frame. 


2.3  Derivation 

A unified  calibration  includes  the  manipulator,  camera-to-manipulator,  camera,  and 
base-to-world  calibrations.  In  our  approach,  most  of  the  effort  is  concentrated  on  the  ma- 
nipulator calibration.  After  the  manipulator  is  calibrated,  the  camera-to-manipulator  and 
base-to-world  calibration  can  be  considered  the  by-products  of  the  manipulator  calibration. 
To  achieve  camera  calibration,  we  adopt  Tsai’s  algorithm  [20]. 

In  this  section,  we  first  describe  two  procedures:  the  procedure  for  solving  the  transform 
matrix  and  the  procedure  for  extending  to  and  . Note  that  Hf , and 
will  be  represented  as  functions  of  commanded  joint  readings  V.  In  the  last  part  of  this 
section,  we  briefly  describe  the  approach  used  for  Tsai’s  camera  calibration. 
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Procedure  for  solving  H^{Y) 

The  modified  D-H  model  previously  described  in  equations  (9),  (10),  and  (11)  is  used  in 
the  following  procedure. 

Step  1:  For  each  joint  axis  i = 1,  • • • ,m,  calibrate  its  poses  at  configuration  j and  the  scale 
factor  Si. 

The  calibrated  joint  pose  relative  to  the  world  frame,  Zj^'{Vj)  and  Z)l^(V^),  is  a function  of 
V where  (1^)  is  the  orientation  of  the  joint  axis  i,  (Vj)  is  a reference  point  lying  on 
the  joint  axis,  and  Vj  is  a vector  (ui,  V2,  • • •,  Vm)  of  joint  readings,  storing  all  the  commanded 
values  of  the  joint  positions  at  configuration  j.  Note  that  the  calibrations  of  the  joints  are 
performed  independently  of  one  another,  and  the  sequence  in  which  they  are  calibrated  is 
arbitrary. 

For  each  joint  i,  do  the  following; 

1-1  Move  the  camera  to  a proper  starting  location.  (By  proper,  we  mean  that  the  camera 
poses  at  the  starting  location  by  moving  one  or  more  joints  and  at  the  next  locations  which 
are  due  to  the  movements  about  the  joint  axis  i can  be  estimated  without  difficultj^)  Record 
all  commanded  joint  readings  V at  the  starting  location  (configuration  j=i).  Then,  estimate 
the  camera  pose  relative  to  the  world  frame  at  the  starting  configuration,  called  Hyy.  Many 
algorithms  are  available  for  estimation  of  camera  pose  [14]  [1]  [20].  Here  we  use  Tsai’s  camera 
calibration  algorithm  [20]  to  estimate  camera  pose.  Note  that  the  starting  position  for  the 
calibration  of  each  joint  does  not  have  to  be  the  same  as  for  other  joints. 

1-2  Exercise  only  joint  i.  Record  the  difference  of  two  commanded  joint  readings  between 
the  starting  and  current  manipulator  configurations,  called  Auj,  then  estimate  the  current 
camera  pose,  called  For  higher  accuracy,  we  may  repeat  1-2  and  obtain  many  An,  and 


1-3  Calculate  the  rigid  body  motion  of  link  i. 

Because  the  camera  is  rigidly  mounted  on  the  manipulator  and  only  joint  i is  exercised  in 
1-2,  the  rigid  body  motion  of  link  i is  identical  to  the  motion  of  the  camera.  To  calculate 
the  movement  (rigid  body  motion)  of  the  camera  between  cl  and  c2,  we  know 


and  therefore 


* HU-  = 


-1 


II 

Hla  * 

'mil 

m.i2 

mi3 

777  14 

= 

77121 

777,22 

m23 

777.24 

m,3i 

m32 

m33 

777  34 

0 

0 

0 

1 

Equation  (24)  represents  the  movement  of  link  i. 


(23) 


(24) 
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1-4  Calculate  i and  5,-. 

For  a re  volute  joint: 

Since  the  motion  from  to  only  involves  a rotation  about  the  joint  axis  i,  the  screw 
displacement  equations  [7]  can  be  applied  as  follows: 

The  rotation  angle  (f)  and  the  orientation  of  the  joint  axis  relative  to  the  world  coordinate 
frame  can  be  expressed  as 

-1  ( ^11  d*  ^22  + ^33  ~ 1 


■ 


(25) 


and 


' T7132 

2 sin  4), 


zr  = { 


mirt  — msi 

2 sin  4>t 


m2i-mi2 
2 sin  4>t 


(26) 


where  the  rriij  are  from  equation  (24). 

One  point  on  the  joint  axis  with  shortest  distance  from  the  origin  of  the  world  frame  is 
selected  to  be  a reference  point  and  is  described  below. 


1 


zr  X {o:;  - o.>r)  / tan  (I)]  - [zr  • (o^  - o:^)  zr]  | (2?) 


where  =0^  ^ represents  the  position  vector  of  the  origin  of  camera  frame  Ci  relative  to 
the  world  frame  W. 

The  scale  factor  s,-  can  be  obtained  as  follows: 

4^i 


Si  = 


Avi 


(28) 


For  a prismatic  joint: 


The  orientation  Zj^  of  the  joint  axis  in  terms  of  the  world  frame  can  be  obtained  from 

qW  _ qW 

_ ^C2 


\pw  _ QW 


(29) 


One  point  is  arbitrarily  chosen  as  a reference  point.  The  scale  factor  s,  is 


|o;r  - 0 


Avi 


(30) 


We  may  take  the  averages  for  the  calibrated  pose  of  the  joint  axis  i and  scale  factor  5,  by 
repeating  1-2  to  obtain  more  H^r  and  Avi  values.  The  average  Z^  and  Si  will  be  : 


l rzW 


An.  Z}^'  = 


EU, 


Av.  Si  = 


I 

Ei  s, 


/ 


(31) 
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where  / is  the  number  of  data  sets. 

Step  2:  Extraction  of  the  constant  link  parameters  Oj,  d*,  9* 

In  order  to  find  the  constant  link  parameters,  and  calibrated  in  the  same  configu- 
ration are  needed.  Since  the  procedure  of  manipulator  calibration  is  flexible,  there  may  be 
different  configurations  for  the  two  neighboring  joint  axes  due  to  the  different  starting  cali- 
bration locations.  Therefore,  it  may  be  necessary  to  transform  Z'j^ {Vj=i)  into  Z'^ 

After  extracting  Zj^' {Vj-i^i)  and  the  next  steps  involve  determining  the  line 

which  is  perpendicular  to  both  axes  (figure  9 ),  computing  the  intersection  of  this  line  with 
each  axis,  obtaining  the  constant  link  parameters,  and  describing  the  link  coordinate  frame. 
The  above  procedure  is  elaborated  below  for  the  cases  2 = 1 and  2 < i < m. 

Case  1:  2 = 1 


♦ Transform  both  axes  1 and  2 to  the  same  starting  configuration  j=2: 

The  pose  of  joint  axes  2 at  configuration  j=2  has  already  been  found  in  step  1.  Joint  axis  1 
is  always  fixed  relative  to  the  base,  therefore  we  have 

zrm^2)  = zr(v'j=i)  (32) 

and 

D'f{Vi=2)  = (33) 

* Find  the  normal  points  0i  and  P2  on  two  neighboring  axes  1 and  2 (figure  9): 

With  the  given  Z^ ^ Z^ , , and  at  configuration  j=2  we  obtain  the  following  [26]:  If 

Z^  X Z^  in  figure  9 is  not  equal  to  zero,  then 


Of  = Of  + 


w 


(nf  - DY)  ■ ((Zf  • Z"')  Zf  - Z^) 
(Zf  ■ Zi^f  - 1 


w 


(of  - or)  ■ (zf  - (zf . zr)  zr) 

otherwise 

Of  = Of 

Pf  = Of  - zf  • (of  - of)  zf 

* Find  ai,ai 

Link  parameters  Ui  and  can  be  found  by 


-01 


w 


(34) 

(35) 

(36) 

(37) 


(38) 


and 


-1  f ryW  r^w\ 

ai  = cos  ( Zj  • Z2  I 


(39) 
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♦ Describe 

From  equation  (9),  Uq  = ao  = 0,  and  the  commanded  joint  reading  Vi  at  configuration  j=2, 
we  obtain 


where 


and 


'cOi  -sOi  0 O' 

501  C01  0 0 

0 0 0 

0 0 0 1 


01  — "Si  • Ui 

di  = 0 for  a revolute  joint 


01  = 0 

di  = Si  ■ Ui  for  a prismatic  joint 


(40) 


(41) 


(42) 


♦ Describe 

Link  frame  1 relative  to  the  world  frame  at  configuration  j=2  can  be  described  as  follows: 

(1)  Let  the  joint  axis  pose  obtained  at  configuration  j=2  be  the  Z axis  of  link  frame  1. 

(2)  Let  the  point  be  the  origin  of  link  frame  1. 

(3)  Let  of  link  frame  1 be  described  as 


a7 


pW  _ QW 

or  I 


ipf 


(43) 


(4)  The  axis  of  link  frame  1 is  then  found  by  taking  the  cross  product  of  Z^'  and  .Yl 


w 


'W 


yW  _ 


X x; 


w 


(5)  Finally,  link  frame  1 can  be  expressed  as 


H 


w 

1 


XW  yW  QW- 

0 0 0 1. 


* Find  the  base-to- world  transform  (or  Hq  ): 

From  equations  (40)  and  (45),  is  obtained  as 

//«'  = (//,»)■’ 

Case  2:  2 < i < m 


(44) 


(45) 


(46) 


+ Transform  joint  axes  i-1,  i,  and  i+1  to  the  same  starting  configuration  j=i+l 
Omit  this  step  if  the  configurations  for  joint  axes  i-1,  i,  and  i+1  are  the  same.  In  fact,  we 
can  omit  this  step  if  the  values  of  Ui,  V2,  ...  u,-i  at  configurations  j=i-l  and  j=i  are  equal  to 
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the  values  of  vi,  U2,  ...  v,_i  at  configuration  j=i+l.  Otherwise,  we  do  the  following: 
Link  frame  i relative  to  the  world  frame  at  configuration  j=i+l  can  be  represented  as 


XT 

0 


K 


w 


0 


or 

1 


i-l, 


(47) 


Note  that  the  above  commanded  joint  readings  V={vi,  U2,  ...  are  recorded  at  configura- 
tion j=i-t-l.  By  inserting  equations  (9),  (10),  and  (11)  into  equation  (47)  and  with  the  given 
, (fli,  ...  ai_i),  (ai,  ...  a,_i),  (d*,  ...  d-.J,  (d*,  ...  (si,  ...  Si_i),  and  (ui,  ...  v,_i), 

we  may  easily  obtain  : 


Replacing  i by  i-1  in  equation  (47),  we  also  obtain  the  following: 


0 

SOj  — i 

COii-l 

0 


* HI_2  * 


c^^-l 

s6i_icai-2 

sd,_iSQ;{_2 

0 


(48) 


(49) 


r)W 

— 1 I IjW  TjO 


1 


= Hlzl  * 


O-i-2 

— SOti-2di-\ 
COLi—2di  — \ 

1 


(50) 


From  figures  9 and  7,  we  can  see  that 

dW  ^ /ri\ 

-I- ai_iA,_i  (51) 

Then,  we  select  one  reference  point  Di  coincident  with  the  point  P,  as 

dY  = PY  (52) 

Therefore,  equations  (48)  and  (52)  can  be  used  to  describe  joint  axis  i at  configuration  j=i  + l . 

* Find  the  normal  points  Oi  and  P,+i  on  two  neighboring  axes  i and  i-fl 
With  the  given  ZY , ^Y  •>  -^l+i  configuration  j=i+l  we  obtain  the  following  [26]: 

If  ZY  X ZY\  in  figure  9 is  not  equal  to  zero,  then 


.H'  _ , (A*:.  - Df)  ■ {{zz,  ■ zr)  zz,  - zr) 


OY  = BY  + 


(ZJY  ■ zYY  - 1 


(53) 


^ ^ • {ZY^  - {ZY^  • ZY)  ZY) 

.+.  .+1  + . zZ)^  - 1 
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(51) 


otherwise 


or = or 


w 

+1 


* Find  a,, a,: 

The  link  parameters  ai  and  a,  can  be  found  by 


a;  = 


pW 
■'  j+l 


and 


a. = cos->  (zr  • zro 


(55) 

(56) 


(57) 

(58) 


* Describe 

Link  frame  i relative  to  the  world  frame  at  configuration  j=i+l  can  be  described  as  follows: 

(1)  Let  the  joint  axis  pose  obtained  at  configuration  j=i+l  be  the  Z axis  of  link  frame  i. 

(2)  Let  the  point  be  the  origin  of  link  frame  i. 

(3)  Let  of  link  frame  i be  described  as 


pw 

■^w  _ ^i+l  ~ 


\p^,-or\ 


(59) 


(4)  The  axis  of  link  frame  i is  then  found  by  taking  the  cross  product  of  and 

yW  ^ 2:^  ^ 2CW  (gQ) 

(5)  Finally,  link  frame  i can  be  expressed  as 

yW  qW- 

0 0 0 1. 


H}^  = 


(61) 


* Find  d*,  $*  : 

The  parameters  d*  and  6*  can  be  calculated  by  the  following  equations 


0*  = 0i  - Si  • Vi 


d*  = di  for  a revolute  joint 

(62) 

where  s,  is  calculated  from  equation  (28)  and 

d,  = |or  - p!^\ 

(63) 

e,  = cos-’  (x.r,  • vr) 

(64) 

or 

0*  = e^ 

d*  = di  — Si  ■ Vi  for  a prismatic  joint 

(65) 
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where  Si  is  calculated  from  equation  (30)  and  d,  and  d,  from  equations  (63)  and  (64),  respec- 
tively . 


Step  3:  Representation  of  the  total  link  transform 

All  constant  parameters  have  been  found  as  described  in  steps  1 and  2.  Hence,  the  total 
link  transform  from  the  base  frame  B (or  0)  to  frame  m can  be  represented  in  the  following 
manner: 


Hl(V)  = H'i  * Hi  * ■ ■ ■ * HZ-'  (66) 

This  means  that  the  total  link  transform  is  a function  of  the  commanded  joint  readings 
V=(?;i,  U2,  ...  Vm)  read  from  the  joint  encoders. 


Step  4:  Calculation  of  the  camera-to-manipulator  transform 
Link  frame  m at  Vm=0  can  be  described  as  follows; 

(1)  Let  the  joint  axis  pose  obtained  in  Step  1 be  the  Z axis  of  link  frame  m. 

(2)  Let  the  point  obtained  in  step  2 be  the  origin  of  link  frame  m. 

(3)  Let  X^_-^  be  the  X axis  ) of  link  frame  m. 

(4)  The  Y axis  of  link  frame  m is  then  found  by  taking  the  cross  product  of  and 


_ 7^ 
■'m  — 


X Y 


w 


(5)  Finally,  the  link  frame  can  be  expressed  as 


qW 


m 

0 


0 


0 


1 


(67) 


(68) 


In  practice,  the  camera  can  be  mounted  on  any  link  of  the  manipulator  depending  on  how 
many  degrees  of  freedom  it  needs.  Therefore,  we  only  need  to  calibrate  up  to  the  link  m 
where  the  camera  is  mounted.  The  transform  can  be  found  as 


HZ  = {Hiy*H^)-'  (69) 

Note  that  is  estimated  at  configuration  j=m.  For  higher  accuracy,  many  calibration 
configurations  may  be  taken  and  the  average  of  camera-to-manipulator  matrices  can  be  used. 


Procedure  for  solving  Hf{Y)  and  H^y(V) 

When  the  manipulator  moves  to  a new  position,  the  camera  pose  will  be  changed.  The 
kinematic  camera  pose  which  is  a function  of  the  manipulator’s  control  variables  (the 
commanded  joint  readings  V)  can  be  derived  as  follows: 

Wf  (V)  = H^{V)  * HZ  (70) 

Once  the  calibration  procedure  described  above  has  been  done,  the  camera  pose  can  be 
obtained  by  inserting  the  current  V into  the  above  equation  . No  repeated  calibration  is 
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needed. 

The  camera  pose  can  be  found  in  the  same  way  using  the  following  equation: 


Hiy{V)  = {H^  * H^(V)  * 


(71) 


Tsai’s  camera  calibration 

In  order  to  avoid  large  scale  nonlinear  optimization,  Tsai  uses  the  radial  alignment  con- 
straint(RAC)  to  decouple  the  calibration  parameters  into  two  groups.  Then,  the  two  groups 
are  solved  using  the  following  two-stage  approach: 

Stage  1:  The  linear  equation  corresponding  to  each  calibration  point  i is 

[Vdi^wi  Vdiywi  Vdi  — XdiXwi  — XdiYwi]  • L = Xdi  (72) 

where  L is  a column  vector  containing  the  five  unknowns  T~^ri,  T'~^r2,  T~^r4,  and 

Ty^Tx.  It  takes  a trick  to  solve  R,  Tx  and  Ty  from  L. 

Stage  2:  The  linear  equation  to  be  solved  in  stage  2 is 

Hxif  T H xiRdf  ^diTz  — ^ di^^Wif'l  T Ywi^s) 

Hyif  + HyiR^fki  — UdiTz  = ydiiXwi'f'i  + Ywirg)  (73) 


where 


Hxi  = Xwi'f'i  + Yw%f'2  + Tx 

Hyi  — A.vVi^4  “I”  YwiV^  “|-  Ty 
Rd  = ^di  + yh 

Xdi  ~ ^x  ^^fi  C'x) 

Vdi  — ^y  {Vfi  ~ Cy) 

3 EXPERIMENTS  AND  VERIFICATIONS 


The  goal  of  this  section  is  to  verify  the  procedure  of  obtaining  and  in  Section 
2.3.  Since  it  is  impossible  to  measure  the  true  we  cannot  compare  the  estimated  and 
the  true  Hf  directly.  Instead,  two  indirect  methods  are  used  for  the  verification  of  Hf . The 
first  method  compares  the  measured  and  the  predicted  moving  distance  (or  angle)  while  the 
second  method  compares  the  measured  and  the  predicted  2D  image  data.  In  this  section, 
the  experimental  setup  is  described  first,  then  the  experimental  procedure  of  estimating  Hf 
as  a function  of  the  joint  readings  V is  elaborated.  Following  that,  the  two  indirect  methods 
are  introduced. 
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The  experimental  setup  consisted  of  a SONY  XC-57  camera  fastened  to  the  last  platform 
of  a positioning  table  with  two  DOFs,  one  horizontal  translation  and  one  rotation  about  a 
vertical  axis  (see  figure  10a).  The  focal  length  of  the  camera  was  16mm.  The  calibration 
targets  (see  figure  10b)  were  an  array  of  disks  drawn  on  paper. 

The  experimental  procedure  for  computing  and  is  as  follows: 

For  calibration  of  joint  axis  1: 

Step  1:  Move  the  manipulator  to  the  starting  position  for  calibration.  (A1  in  figure  10c 
represents  the  camera  center  at  the  starting  position  and  the  arrow  represents  the  camera 
optical  axis.)  Record  the  commanded  joint  readings  V and  estimate  the  camera  pose 
from  the  extrinsic  camera  calibration.  Store  the  set  of  data  V).  Note  that  the  world 

coordinate  system  is  defined  by  the  calibration  plate. 

Step  2:  Move  that  particular  joint  to  the  next  position.  ( A2  in  figure  10c  is  the  camera  center 
at  the  new  position)  After  the  movement,  record  the  current  commanded  joint  readings  V 
and  perform  the  extrinsic  camera  calibration.  Store  the  new  set  of  data  {H^,  V). 

Repeat  steps  1 and  2 for  joint  axis  2.  PI  and  P2  in  figure  lOd  represent  the  camera  centers  at 
the  starting  and  new  positions  for  joint  axis  2.  Then,  we  follow  the  procedures  described  in 
section  2.3  to  obtain  i/®(V),  and  As  indicated  in  equations  (70)  and  (71), 

the  kinematic  camera  pose  Hf  (or  H^)  can  be  expressed  in  terms  of  V.  Therefore  with  the 
given  commanded  joint  readings  V,  the  kinematic  camera  pose  can  be  predicted. 


Two  indirect  methods  for  the  verification  of  and  as  follows: 

Method  1: 

Since  the  translation  distance  (or  rotation  angle)  of  a camera  can  be  calculated  from  the  es- 
timated , we  can  compare  the  estimated  and  the  measured  distance  or  angle  to  indirectly 
verify  the  estimated  . In  the  experiment,  we  move  the  camera  to  11  positions  along  the 
translation  axis  and  another  11  positions  about  the  rotation  axis  . The  commanded  joint 
readings  V at  each  position  are  recorded.  Then,  we  substitute  the  readings  V into  the 
function  (found  in  the  experimental  procedure  for  and  H^y)  to  estimate  Hf  and  then 
calculate  the  moving  distances  or  angles  . The  true  moving  distances  or  angles  for  the  po- 
sitioning table  were  measured  with  high  accuracy  using  encoders  in  the  positioning  table  as 
a comparision.  The  result  is  listed  in  table  1 for  translation  and  table  2 for  rotation.  The 
first  row  of  tables  1 and  2 are  the  measured  translation  distance  and  rotation  angle.  The 
difference  between  the  predicted  and  the  measured  values  are  listed  in  the  second  row.  The 
third  row  is  the  percent  error.  Since  all  percent  errors  in  tables  1 and  2 are  less  than  0.0081% 
and  0.373%,  respectively,  the  proposed  procedure  for  predicting  Hf  is  quite  accurate.  The 
results  in  tables  1 and  2 also  showed  that  the  percentage  error  is  decreased  as  the  distance 
or  rotation  angle  increases. 


Method  2: 

There  are  various  ways  using  the  function  of  or  H^y.  One  way  is  to  predict  the  2D 
image  coordinates  corresponding  to  3D  object  points.  The  following  experiment  uses  this 
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procedure  to  indirectly  verify  the  function  H^.  In  the  experiment,  we  move  the  camera  to 
five  positions  (B1  through  B5  in  figure  10c)  along  axis  1 and  five  positions  (Ql,  Q2  in  figure 
lOd  and  SI,  S2,  S3  in  figure  lOe  ) about  axis  2.  All  the  joint  readings  are  recorded.  For  each 
position,  substitute  the  joint  readings  into  the  function  The  2D  image  coordinates  can 
be  predicted  from  the  given  intrinsic  camera  parameters  and  the  known  locations  of  the  3D 
target  points.  Since  the  2D  image  data  corresponding  to  the  calibration  target  points  can 
be  directly  measured  at  each  camera  position,  the  measured  2D  image  data  are  compared 
to  the  predicted  data.  The  results  for  translation  and  rotation  are  listed  in  tables  3 and  4 
respectively.  Since  42  target  points  were  used,  the  average  errors  listed  in  tables  3 and  4 are 
calculated  from  : 


AverageError  = (74) 

Ylt=\{fTieas.  image  coord.  — predicted  image  coord.) 

42 

The  result  shows  that  average  errors  for  translation  range  from  0.66  to  0.388  pixels  and 
for  rotation  from  0.523  to  0.406  pixels.  Note  that  the  inaccuracy  due  to  the  prediction  of 
is  contributing  only  part  of  the  errors  shown  in  tables  3 and  4.  (The  inaccuracies  in 
the  intrinsic  camera  parameters,  the  coordinates  of  the  target  points,  the  measured  image 
coordinates  are  contributing  errors  to  tables  3 and  4 as  well.)  The  actual  errors  due  to  the 
prediction  of  H^y  should  be  smaller  than  the  errors  listed  in  tables  3 and  4. 


4 CONCLUSION 

In  this  paper,  we  have  presented  a new  technique  for  the  unified  calibration  of  an  active 
camera  system.  In  our  approach,  a Denavit-  Hartenburg  kinematic  model,  augmented  with 
the  capability  of  correcting  errors  caused  by  joint  variable  values  used  from  joint  readings, 
was  established.  Then,  an  analytical  technique  was  developed  to  perform  the  manipulator 
calibration.  Since  the  calibrated  camera  poses  and  link  frames  are  related  to  the  world  frame, 
not  only  the  camera-to-manipulator  and  base  -to-world  calibration  is  very  straightforward, 
the  procedure  of  solving 


A B 

can  also  be  eliminated.  Two  experiments  were  performed  to  verify  the  accuracy  of  the  pro- 
posed technique.  One  was  to  examine  the  moving  distances  and  angles,  the  other  was  to 
verify  the  estimated  2D  image  coordinates.  Both  experiments  showed  that  the  proposed 
technique  is  highly  accurate. 

The  proposed  method  has  the  following  advantages: 

(1)  Unified  calibration  - The  calibration  of  the  manipulator,  camera-to-manipulator,  camera, 
and  ba^e-to-world  is  integrated.  The  same  experimental  setup  is  used,  and  the  intermediate 
results  are  shared. 
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(2)  Simple  computations  - Only  the  form  of  one-equation-solving-one-parameter  is  used  in 
the  manipulator,  camera-to-manipulator,  and  base-to-world  calibration. 

(3)  Efficient  - The  camera-to-manipulator  and  base-to-world  calibrations  are  the  by-products 
of  the  manipulator  calibration  procedure. 

(4)  Accurate  - For  the  manipulator,  camera-to-manipulator,  and  base-to-world  calibrations, 
the  solution  is  in  closed  form  and  therefore  accurate.  No  approximation  is  used. 

(5)  General  use  - A manipulator  with  any  type  of  kinematic  model  can  be  used. 

(6)  No  special  equipment  - Only  a CCD  camera  and  a calibration  target  are  used. 

(7)  One-time  calibration  - Because  the  kinematic  camera  pose  is  expressed  as  a function  of 
the  joint  readings,  repeated  calibration  is  not  needed. 
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Fig.  1 Unified  Calibration 
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Fig.  2 Camera  Coordinate  Frame 
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Fig.  3 World  Coordinate  Frame 
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Fig.  4 Link  Coordinate  Frame 
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Fig.  5 Transform  Mapping 
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Fig.  6 Transform  Operator 
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Fig.  7 Link  Coordinate  Frames  and 
Parameters  of  a Manipulator 
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Fig.  9 The  Intersection  Line  Perpendicular  to  the  Two  Joint  Axes 
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(a) 


(b)  Calibration  Plate 
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Fig.  10  Experimental  Setup 
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Trans- 

lation 

(mm) 

100 

200 

300 

400 

500 

600 

700 

800 

900 

1000 

error 

(mm) 

0.0081 

0.013 

0.018 

0.023 

0.028 

0.033 

0.039 

0.044 

0.049 

0.054 

error 

(%) 

0.0081 

0.0066 

0.0061 

0.0059 

0.0057 

0.0056 

0.0055 

0.0055 

0.0054 

0.0054 

Table  1 : Results  of  experiment  in  method  1 (translation) 


Rota- 

tion 

Angle 

(rad) 

0.052 

0.104 

0.157 

0.209 

0.262 

0.349 

0.523 

0.698 

0.872 

1.047 

error 

(10-2 

rad) 

0.20 

0.31 

0.44 

0.58 

0.73 

0.97 

1.5 

1.9 

2.4 

2.9 

error 

(%) 

0.373 

0.294 

0.282 

0.278 

0.277 

0.277 

0.277 

0.277 

0.278 

0.278 

Table  2:  Results  of  experiment  in  method  1 (rotation) 


Camera 

Position 

B1 

B2 

B3 

B4 

B5 

Average 
Error  (pixel) 

0.660 

0.614 

0.523 

0.433 

0.388 

Table  3:  Results  of  experiment  in  method  2 (translation) 


Camera 

Position 

Q1 

Q2 

SI 

S2 

S3 

Average 
Error  (pixel) 

0.513 

0.433 

0.523 

0.466 

0.406 

Table  4:  Results  of  experiment  in  method  2 (rotation) 
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